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Abstract 

We consider the gamma process perturbed by a Brownian motion (independent of the gamma process) as a degradation 
^— ^ ■ model. Parameters estimation is studied here. We assume that n independent items are observed at irregular instants. 

p^ \ From these observations, we estimate the parameters using the moments method. Then, we study the asymptotic 

properties of the estimators. Furthermore we derive some particular cases of items observed at regular or non-regular 
j^ I instants. Finally, some numerical simulations and two real data applications are provided to illustrate our method. 
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1. Introduction and model 



C^ i Many authors model degradation by a Wiener diffusion process. Doksum and Hoyland JUj] applied the Brown- 

^ I ian motion with drift to a variable-stress accelerated life testing experiment. Next Whitmore ||2[] extended the Wiener 

degradation process with the possibility of imperfect inspections. Another interesting extension is the bivariate Wiener 
process considered by Whitmore et al.fS] in which the degradation process and a marker process (that can be seen 
<^ . as a covariate in medical applications) are combined. Finally Wang |4] has studied the maximum likelihood infer- 

T^ ' ence method for a class of Wiener processes including random effects. According to Barker ||5|], this process is no 

longer monotone, but can take into account minor system repairs over time. In addition, this process can be negative. 
^N ' Although such behaviours have difficult physical interpretation. They can be explained by above mentioned phenom- 

ena like minor repairs or measurement degradation errors. It means that for some types of degradation models, the 
•/^ ' possibility of non-negative increments is appropriate. 

However in many situations the physical degradation process can be considered as monotone while the observed 
process is a perturbation of the degradation process and then can be no longer monotone. Physical degradation pro- 
cesses are usually described by monotone Levy processes like the gamma process or the compound Poisson process. 
These process implies that the system state cannot be improved over time, and then this system cannot return to its 
original state without external maintenance actions. The gamma process was originally proposed by Abdel-Hameed 
i-j ' M in order to describe the degradation phenomenon. This process is frequently used in the literature since it is prefer- 

able from the physics point of view (monotonic deterioration). Moreover, calculations with this process are often 
explicit, it properly accounts for the temporal variability of damage and allows determining optimum maintenance 
policies 

In this paper, we propose a degradation model D - (D,),^q which combines these two approaches as follows; 

Vf > , D, = y, -H tB, 

where (l',)r>o is a gamma process such that Y[ is gamma distributed with scale parameter ^ > and shape parameter 
a > and where {B,),>o is a Brownian motion. This model is defined for t eR and the two processes are assumed to 
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be independent. Without loss of generality, we can assume that r > since tB, and -tB, have the same distribution 
for all f > 0. The motivations behind considering such a model are the following ones. First, this model embeds 
the two approaches mentioned above. Indeed, it is clear that when t - 0, this model turns to be a gamma process. 
Moreover, if a/^ tends to b > Q and a/^^ tends to 0, then this model converges weakly to a Brownian motion with 
positive drift b. Second, measurements of degradation tests reflect measurement errors. Hence, the role of Brownian 
motion in this model can be interpreted as measurement errors. Finally, our model can take into account minor repairs 
considered on system over time. 

In this paper, estimation of model parameters is derived using the method of moments. In literature the two most 
common methods of gamma process parameter estimation, namely, maximum likelihood and method of moments, are 
discussed in JtI]. Both methods for deriving the estimators of gamma process parameters were initially presented by 
^inlar et al.[8]. Besides, Dufresne et al.|9] propose to use a conjugate Bayesian analysis in which the scale parameter 
of the gamma process is assumed to have an inverted gamma distribution as prior. A method for estimating a gamma 
process by means of expert judgement and a Bayesian estimation method is also discussed in JtI]. Finally maximum- 
likelihood and Bayesian estimation of the parameters of the Brownian stress-strength model was studied by Ebrahimi 
and Ramallingam [JjOJ and Basu and Lingham [11,1. 

The organization of the paper is as follows. First, we present a general case where n independent processes are 
observed at irregular instants. Both number of observations and instants are different for each degradation process. 
Parameters estimation and asymptotic properties (consistency and asymptotic normahty) of the estimators are stud- 
ied. Next, we derive some particular cases of items observed at regular or non-regular instants. Finally, numerical 
simulations and two real data applications are provided to illustrate our method. 

2. General case 

Let (d^"^] ^ be a sequence of independent and identically distributed (i.i.d.) copies of the degradation model 
described in tne previous section. The i-th degradation process is observed A^, times such that A^, € N*. For all 
/ e N* and all j e {0, . . . , A^,), we will denote by tjj these instants (with convention that for all / e N*, f,o = 0). Let 
6 - (^, a, T^j e = R* X M* X M+ the parameter space of the model. Estimation of model parameters is derived using 
the method of moments. Asymptotic properties are then studied. 



2.1. Parameter estimation 

For any / e N*, for any 1 < j < A^, and for any A: € N, we denote by m. the k-th moment and by by rfv. . the ^-th 
central moment of increments AD, , - D, - D, : 

mf = E [aD^ and m*** = E [aDij - E [AD,y])* 
Since the gamma process and the Brownian motion are independent, the first three moments are equal to: 
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—Atij + 3-^{Atij) +[|Af,;j +3—{Atij) . 



These expressions can be easily computed from the moments of the gamma distribution (see Ill2ll for non-central 
moments and see [13] for a recursive formulae of the central moments) and from the ones of the normal distribution 

Let / be the foUowing differentiable map from to /(0) defined by: 
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The function / is bijective. Then, the parameters can be expressed in terms of m''^\ m and m ' as follows: 
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Let m„ be the empirical estimator of the first central three moments: 
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[ADij - Atijmi'^f /At, 



The estimator 6„ - f ' (m„) of = (^, a, t^j is therefore defined by: 
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2.2. Asymptotic properties 

We first recall the following theorem (for more details see Theorem 6.7 in lll411 '). 

Theorem 1. Lef (fln)„>i be a sequence of positive numbers. Let (X„)„>i be a sequence of independent random vari- 
ables. We set S „ — Y^ X^. Ifa„ > oo and J] (Var [X„] /a^) < oo, then {S „ — K [S „]) /a„ > 0. 

Then we establish the following lemma. 



Lemma 2. We have that 2 A^„ 2 M- < oo. 



Proof. We set A„ = A^i + . . . + A^„. One can note that A^„ - A„ - A„_i . Then it follows that 
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In the sequel we will prove the consistency of 0„. 
Theorem 3. Under the following assumptions : 

N„ 1 / « \-2 

(Hi) 2 Z AfJ [ZNi] < ex,, 
«>i;=i^ ' V=i / 

(H2) 3 d,„ \/ieW,\/je{l,..., Nil At-.j < d, , 
6„ converges almost surely to 6 as n tends to infinity. 

Proof. One has to prove that m„ tends to m a.s. as n tends to infinity. Indeed, since /"' is continuous on /(©), 

■I — 11 — ^■^■ 
we obtain, by applying the continuous mapping theorem II15I1 . that 0„ > 6. Hence let us prove the almost sure 

convergence of m„. 

3 



Almost sure convergence of m„ to m*''. By applying Theorem[ri it holds that: 
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Indeed, for all / e N*, A^, > 1, implying that 2 N, > oo. Moreover by Assumption (Hi) and since increments are 

independent, one gets the following term is finite: 
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Thus m„ > m'^ '. 
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Almost sure convergence of m„ to m^ . Let us set: 



-^'^HZ^' ZZK) (AAv-E[AD,]r 



/=i / i=i y=i 
Hence the following decomposition holds: m„ - nv ' - m,, - m„ + m\ - m '. Thus one has to prove that both 

• — • (2) /2\ /2\ /o\ 

m„ - m„ and ih„ — nv ' tend almost surely to as n tends to infinity. 
1 . Almost sure convergence of m„ - m„ to 

^(2) . (2) 



Y, Ni [m(" - m("] ^ ^ [(2AD,v - 2E (aD,,)) + (E (aD,,) - Af,-,.ml'')l 
/=i / /=i j=[ 

[«<') - «<')]' [j] n] ' I; I; At, - 2 [m<') - m'')] [|] m] ' ;^ i (A^'7 - E (AZJ,)) ■ 
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Using Assumption (Hi) and as shown previously one can deduce easily that the first term of the last expres- 
sion tends to as n tends to infinity. Moreover the second term tends also to as « tends to infinity since 

Y.Ni\ Y.Y. i^Dij - e(aD,,)) -^ 0. Indeed using LemmaE Assumption (H2) 

/-I / /-I /=1 n— >(X) 

and since increments are independent, one gets: 
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Thus one can deduce that m„ - m„ — —^ 0. 

^(2) 4.„ —(2) 



. (2) a.s. 

2. Almost sure convergence of m^^^ to m*^'. Applying Theorem[T] it follows that: 



-\m zz(Kr'(AAv-EKr-^<^))f^o. 
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Indeed, since increments are independent, one gets that there exists constants ki (0) and K2 (0) depend only on 
(one can compute them explicitly) such that: 
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which is finite using Lemma|2]and Assumption (Hi) . Thus it follows that m„ — —^ m 

n—>oo 
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Almost sure convergence of m„ to m^ . Similarly as above, we set: 

n \-l « A'; 

1 
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Next we have the following decomposition: ot„ - m ' - m„ - ot„ + m„ - m '. Let us check that m„ - m„ 
tends almost surely to as n tends to infinity. 
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Let us show that we can replace in„ by m*'' in the above expression. Using Assumption (H2), IE (AD,j j = 
Atijin'-^^ and the fact that m„ tends to m*'' as n tends almost surely to infinity, it follows that 
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Thus it follows that 
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which tends almost surely to as « tends to infinity since 



-1 « Ni 
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and m„ — -^ m^''. Then we deduce that m„ - m,, > 



2. Almost sure convergence of m„ to m* . After tedious calculations, one obtain that there exists constants 



Kj, (0), K4 (6) and k^ (6) depending only on 9 such that: 
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All these series, using Lemma|2l (Hi) and (H2), are convergent. Thus we have that m„ — ^ m ' 

Before showing the asymptotic normality of m„, we shall establish the following Lemma. 
Lemma 4. IfiHi) and the following assumption hold 
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Proof. To prove this Lemma we apply the central limit theorem of Lindeberg-Feller 111511 since the increments are 
independent. We set first by ADij - AD,j - E (AD, A. Then we have 
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We set Xij - [Xjji , Xij2 , Xij^ ) . Let us check the first condition of the Lindeberg-Feller theorem. For any e > 0, 
we have: 
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Moreover because 
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Thus it follows that Equation (1) implies that 
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where the last inequality is obtained by applying the Young inequality. Moreover one can check that for any q eW, 
we have 
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where B ~ N(0,1) and Pol^_i (Af, j denotes a polynomial of order q - 1 with respect to Af, the coefficients of which 
depend only on 6. Then Equation (2) is equal to 
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which tends to as n tends to infinity since 2 M 2 2 (Af/)) Poln (Af,A is bounded using Assumptions (H2) 

v=i / '=1 i=i 
and (H3). 

Next the variance covariance matrix Z, of X, is given by 



Var(AD,) 



E 



e(a4) 

|a4) E (aD^ - E (adJ) E (aD^ Var [(aZ), - E (aZ),))' 



AA 



e(a4) 
(aa7-ie(aa,))' 



Thus the second condition of Lindeberg-Feller theorem is also satisfied since: 
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where the finite terms of I.^°°\ under Assumption (H3), are obtained from the following equations: 
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Finally we conclude that 
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In the sequel we will prove the asymptotic normality of 0„. First, let us prove the asymptotic normality of m„. 
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Theorem 5. Under Assumptions (Hi — H^), we have: 
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Proof. First we note that 

n y/2 

Y^Ni {rhn-m) = y^Ni 



i=\ ) 

Second we have 

1/2 



1/2 



(=1 / 



mi"-m(i) 



-:^(2) .(2) , .(2) —(2) 

m„ - m„ + m„ — m 

-2.(3) . (3) _ (3) — (3) 

\m^ — m\ + m\ — rw ' j 



- Z«' 



1/2 



i=\ ' 



( 

^(2) - (2) 
^(3) .(3) 



Z«' 

/=i / 



1/2 



. (2) —(2) 

m„ — m . 



2M- (-f-4^') (3) 

V /= 1 / 



i=i / 



1=1 / 



which tends to as « tends to infinity. Indeed we check that the first term of the last expression tends in prob- 



abihty to as n tends to infinity since 2 A^, m*'' - m„ is normally distributed and, as shown previously, 
Z M Yj Yj i^Dij - E (AD, A) tends to as n tends to infinity. Moreover the second term in the right-hand 
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Indeed, since increments are independent, one gets that there exists constants a:i (0) and K2 (ff) depending only on 6 
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which is convergent using Assumption (H2) and Lemma|2] Moreover we have: 
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Since / is a differentiable and bijective function and / ' is continuous on /(©), then we obtain the asymptotic 
normality of 6„ by applying the (5-method (see Theorem 3.1 in OlSll ). 



Theorem 6. Under Assumptions {H\ — Ht,), we have: 
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2.5. Statistical inference 

As an application of theorem |6] one can construct the confidence interval with asymptotic level I - § for each 
parameter: 
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where Z[_» is the critical value of the standard normal distribution and o"f^,j ,cr(a„) and crrr^j are the asymptotic 

standard deviation of ^„, c?,, and t"^ respectively (square-root of the diagonal of variance-co variance matrix M appeared 
in Theorem|6ll. Thus one can test whether t^ = or not, that could be important to determine if the model is a gamma 
process or not. Moreover, applying the 5-method and using the previous theorem, it can be proved that 



yfn 



ll e) 



-^A^(0,GiMiG[), 



where Mi is the top left 2x2 block matrix of M and where G\ - (-^, -k) ■ Hence one can obtain the confidence 
interval with asymptotic level 1 - 1? for aj^^. As mentioned in the introduction, it is useful to test the Brownian motion 
with a positive drift model against the gamma process model. 



3. Particular cases 

Before considering several particular cases corresponding to various sampling scheme, we will introduce some 
stronger but more comprehensive assumptions: 

(Ai ) Same number of observations for all the processes: V/ eW,Ni - N 

(A2) Same instants of observations for all the processes: V/ e N*, Vy e {!,..., Ni) , f,j = tj 

(A3) Regular instants (not necessary the same instants for all the processes): V/ e N*,37', such that Vy e {1, . . .,A^,) , Af,j 

TilNi 

(A4) Same time interval for observations: 3T such that V/ e N*, f,w, < T 
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(As) Uniformly bounded delay between consecutive observations: 3di > 0, V/ e N*, Vy e {!,..., A^,) , Af,j > di 



Note that (A2) => (Ai). More interesting are the relationships between Assumptions (Hi - H3) and Assumptions 
(Ai - As). In particular, one can easily check that (A4) => (H2) and (Ai) & (A5) => (Hi). Moreover simplifications 
may occur under some assumptions. For instance, if (A3) and (A4) are satisfied, then (Hi) and (H3) are equivalent 
respectively to: 



n>\ 



(H'l) ZnUznA <oo 



!=1 



-2 



(H^) Vm e {0, 1 ) , Jim ^ M- ^ A^^-" 



< 00 



In addition if (Ai) holds then (Hj) and (H3) are satisfied. We will now consider five different special cases that can be 
described in terms of Assumptions (Ai - A5): 

• Case 1 - Same number of observations a the same regular instants over [0, T]: (Ai) - (A4); 

• Case 2 - Same number of observations at the same non-regular instants over [0, T] : (Ai ), (A2) and (A4); 

• Case 3 - Ni = i and regular instants over [0, T]: (A3) and (A4); 

• Case A - Ni - i and regular instants over [0, iT]: (A3) and (A5); 

• Case 5 - Ni = 2'"' and regular instants over [0, T]: (A3) and (A4). 

One can easily check that estimators in cases 1, 2 and 4 are consistent and asymptotically normal. At least, the 
estimator in case 3 is consistent but asymptotic normality cannot be established using our results. In the last case one 
can check that consistency and asymptotic normality cannot be established using our results. 

4. Numerical illustration 

Here we illustrate our theoretical results throughout simulations. We recall that the parameters were fixed as 
follows: ^ = 1, ff = 0.02 and t^ - 0.02. The number of observations for each item was set to A^ = 3 instants between 
and T = 1000 such that Af,i = 200, Af,2 = 300 and Af,3 = 500. We have computed the empirical bias, the empirical 
squared error (MSB) and the empirical standard deviation (StD) for 1000 repetitions. Table [1] Table |2] and Table |3] 
report respectively the empirical bias and the empirical standard deviation for several sample sizes n. Based on results 
given in the Tables[T]|2]and[3]we note the the average of degradation is well estimated whatever the sample size since 
the larger n is, the better the estimation is towards Bias, MSB and StD. 



Table 1 : Empirical bias 



Table 2: Empirical MSE 



Bias 


50 


100 


200 


or 

2 


2.22e-l 
5.55e-3 
6.21e-3 


1.44e-l 
3.61e-3 
1.16e-3 


6.25e-2 
1.57e-3 
5.01e-4 


1000 repetitions 


937 


983 


998 



MSB 


50 


100 


200 


^ 


8.29e-l 


3.35e-l 


7.07e-2 


a 


5.25e-4 


2.12e-4 


4.56e-5 


t2 


9.67e-5 


5.88e-5 


3.01e-5 


1000 repetitions 


937 


983 


998 



5. Real data application 

In what follows, we present the results that we have achieved in the implementation of the data given in the 
following sections: 
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Table 3: Empirical standard deviation 



StD 


50 


100 


200 


^ 


6.32e-l 


5.61e-l 


5.21e-l 


a 


7.78e-l 


7.48e-l 


7.41e-l 





O.llel 


5.01e-l 


2.12e-l 


1000 repetitions 


937 


983 


998 



5.7. NIST dataset 

An example of dataset can be found in |'161. Fifteen components were tested under three different temperatures 
65°C, 85°C and 105°C. Degradation percent values were read out at 200,500 and 1000 hours. We have estimated 
the three parameters of the degradation models and we have constructed, see Table |4] the 95% confidence interval 
of each parameter First, we denote that values within brackets constitute the standard deviation of each parameter 
Let us discuss the results. One can note that ^ decreases as temperature increases. Moreover r^ and a/^^ increase as 

Table 4: Estimation of parameters and 95% confidence intervals 



Pai-ameters 


^ 


a 


t' 


a/^' 


Estimation (65 °C) 


5.51(1.31) 


0.01 (0.002) 


0.0001 (19.96) 


0.0006 


Confidence intervals (95%) 


[4.84; 6.18] 


[0.01; 0.02] 


[0; 10.11] 


[0.0004; 0.0007] 


Estimation (85°C) 


0.71 (0.37) 


0.012 (0.49) 


0.0068(0.111) 


0.025 


Confidence intervals (95%) 


[0.51; 0.89] 


[0;0.26] 


[0;0.06] 


[0; 0.54] 


Estimation (105°C) 


0.29(1.87) 


0.02(0.14) 


0.27(1.51) 


0.25 


Confidence intervals (95%) 


[0;1.24] 


[0;0.09] 


[0;1.04] 


[0;1.06] 



temperature increases. However a is almost stable. Finally from the confidence intervals at 65°C our model turns to 
be a gamma process since one can accept that r^ = and a/^^ + 0. 

5.2. Heating cable test data 

Whitmore and Schenkelberg [17] presented some heating cable test data. The degradation of the cable is measured 
as the natural logarithm of resistance. Degradation is accelerated by thermal stress so temperature is used as the stress 
measure. Five test items were baked in an oven at each test temperature. Three test temperatures were used, 200°C, 
240°C and 260°C, giving a total of 15 items. The clock times are in thousands of hours. The cable is deemed to 
have failed when the log-resistance reaches ln(2) = 0.693. The test continued at the lowest test temperature 200°C 
until the test equipment was required for other projects. We have estimated the three parameters of the degradation 
models and we have constructed, see Table |5] the 95% confidence interval of each parameter. Like above, we denote 
that values within brackets constitute the standard deviation of each parameter. One notes that ^, a and aj^ increase 
as temperature increases. However it is not the case for t^. Although we have the same number of items as for 
the previous data set, here we observe standard deviations with very large values. It is therefore difficult to choose 
between one of the two sub-models, and more generally it may be interpreted as bad fitting of the model. 

6. Concluding remarks 

In this paper we have proposed a gamma process perturbed by a Brownian motion as a degradation model for which 
we derived parameters estimator. Asymptotic properties of this estimator have been established. Since degradation of 
system is also influenced by the environment, it is interesting to consider a model integrating covariates. Such model 
will be studied in a forthcoming paper. 
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2.18(5.07) 


0.47(1.41) 


0.03 (9.97) 


0.09 


[0.77; 3.58] 


[0.08; 0.86] 


[0;2.81] 


[0;0.21] 


2.38 (6.74) 


2.17(3.10) 


0.14(11.57) 


0.38 


[0.51; 4.25] 


[1.31; 3.03] 


[0;3.35] 


[0;0.88] 


2.75(9.01) 


5.13(3.78) 


0.04(17.31) 


0.67 


[0;5.74] 


[3.87; 6.38] 


[0;5.78] 


[0;2.01] 



Table 5: Estimation of parameters and 95% confidence intervals 

Parameters ^ a r^ a/^^ 

Estimation (200° C) 

Confidence intervals (95%) 

Estimation (240° C) 

Confidence intervals (95%) 

Estimation (260° C) 

Confidence intervals (95%) 
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